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TAPES IN DISTRIBUTION 


In 1971 we changed from % inch C.V. to 4 inch 
AV. reel to reel format. Since mid-1974 our tapes have 
originated on % inch cassettes. 

Although the format is irrelevant to means of distri- 
bution, it influences, in ongination, the basic textural 
characteristic of the image. and also states the non- 
industrial conditions under which they were made. 

The descriptions of each tape do not attempt to 
evaluate the image content itself, but to indicate the 
electronic concept, applied in the construction of 


taped images. 


The tapes are in color unless otherwise indicated. 

In a great majority of our tapes, we have used sounds 
generated by video images or images conceived from the 
sound spectrum. 

Tools used in this process were standard audio 
synthesizing instruments, voltage controlled oscillators 
and other frequency generated circuits. 

Until now, before our encounter with the computer, 
our expression of image-sound-image has been direct 
and linear, partly on purpose, partly because we lacked 
additional, more complex coding tools. Especially in its 
primitive interface of cause and effect, the process has 
revealed to us the behavior of the medium, its materiality 
and its control modes. 

Our work has developed through design and use of 
special videotools, which have progressively contributed 
to the formal and conceptual complexity of our imagery. 

In this process, we hve worked in close collabora- 
tion with several tool designers and builders, notably 
Eric Siegel, George Brown. Bill Etra, Steve Rutt, 

Don McArthur and Jeffrey Schier 


TOOLS 
R/E Scan Processor 
Produced in 1974 by Steven Rutt and William Erra. 


An analog device using a programmable deflection svstem of 
the cathode ray tube to reshape standard television -rames. 


Dual Colorizer 

Produced in 1972 by Eric Siegel. 

A device which assigns color to black and white images 
according to the grey scale differences. “Dual” indicates that 
there are two separate colorizing channels. 


Multikeyer 

Produced in 1973 by George Brown. 

A device which assigns up to six layers of discrete camera 
images, allowing manipulation of these images as it they were 
in real foreground/background relationships. Additionally, in 
this real time process, the re-assignment of the plane-location 
can be made. Another operational mode quantizes the grey 
scale of a single input into six discrete grey levels. 


Programmer 

Produced in 1974 by George Brown. 

The complexity of the multikeyer operation necessitated 
automation of its processes. We therefore commissioned 
George Brown to construct a programmable control device 
able to store a sequence of operations and perform them 
automatically. Brown's approach was to construct a fully 
digital instrument. 


H.D. Variable Clock 

Produced in 1972 by George Brown. 

A pulse generator operating in the regions of the horizontal 
sync ,15,750Hz! capable of finely controlled deviation from the 
standard horizontal frequency. It enabled us to introduce the 
dynamic element of controlled horizontal drift to the video 
image. 

Field Flip/Flop Switcher : 

Produced in 1971 by George Brown. 


A variable speed programmable vertical interval switcher, 
selecting between two sources at specified field multiples. 


Whenever a tool is specified in the tape description, the 
credit goes to those individuals. 
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Video synthesis is electronic animation. The video synthesizer accepts 
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standard video signals from a camera, film chain, video-tape or graphics 


generator. The synthesizer then processes the signal and applies a com- 


bination of effects to change position, size and aspect ratios; to re-shape 
and add motion to fixed graphics or live scenes. It can generate chroma 
keys in any desired shape and then re-shape, blend or animate the key 


inserts on a real time basis. 


The RUTT/ETRA Synthesizer is a video analogue computer. In operation 

the incoming video signal is separated into its vertical, horizontal and 
intensity components. These components are processed through a series of 
multipliers, summing amplifiers and function generators to modify both 

the raster format and the intensity of the processed video. The Synthesi- 
zer can lighten or darken specific portions of the picture and can control 
the raster which causes the image to be reshaped. The components of the 
processed video are fed into a specially designed kinescope display where 
they are re-assembled into a standard image. This image is picked up by 
a monochrome camera, colorized, and fed into a switcher or video tape 


recorder. 


Complex graphics that would require days to animate can be video synthesized 
in minutes. The synthesizer may be used to add motion to titles and logos 
and to instantly alter size and position of electronically generated graphics. 


As a tool in video art it can modify existing patterns or generate com- 


pletely new ones. Patterns may be controlled by a combination of pre-set 
&. ‘programming and manual control. The system may be interfaced with audio 


equipment enabling the visuals to be synchronized with music or speech. 


LIVE BROADCAST - VIDEOTAPE :- FILM 


~ “\ISTANT ANIMATION * DYNAMIC LOGOS AND TITLES - NEWS, 
— PORTS, WEATHER COMMERCIALS « VISUAL AIDS- SPECIAL EFFECTS 
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SEPARATION < OPTIONAL ACCESSORIES === 


"RE-4—A Video Synthesizer ~ -.¢:55%: 
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DISPLAY CONTROL UNIT 
Two separate sets of control varying image: 


Height Reduces to thin line; expands inverted 
image beneath. Rotates horizontally. 


Width Varies and inverts. Rotates vertically, 
Depth Advances and receeds., 

Vert. Position Up-down on or off screen, 
Horiz. Position R-L on or off screen. 
Intensity Controls brightness. 


Horiz. Center Moves image through preset patterns, 
ala words around theatre marquee, i 


Vert. Center Adjusts vertical axis. 
Plus...SCAN RATE switch.,.DISPLAY 0°/90° 
rotating image 90°.. .INT./EXT. SYNC. 
ANIMATION CONTROL MODULES 
Summing Amplifier Combines functions. 
Diode Module Divides waveforms & timing ramps. 


Ramp Generator Automatic control of animation at 
preset speed and period of time. 


Audio Interface Drives animation with audio, bio- 
feedback or other external signals. 


(2) Waveform Generators Produces graphie forms for 
display or for reshaping and animating images. 
Controls frequency, waveshape, duty cycle, amplitude 
& Frequency modulation, sync. . 


DISPLAY UNIT (Type A) - ~ 
Displays 525-line synthesized images. 
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RE-4-B Video Synthesizer — ok = 


Similar to RE-4-A, but substitutes Type B DISPLAY 
(1050-line scan) yielding full NTSC resolution in 
rescanned image for two-inch hi-band videotape or 
direct telecast, ; 


Manufactured by RUTT ELECTROPHYSICS 


SEND FOR full details about RE systems, optional 


plug-in units and accessgries,. 
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MPCS COMMI""SATIONS INDUSTRIES, INC. 
424 We St., New York 10019 
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-RUTTETRA VIDEO SYNTHESIZER 


VIDEO A/D CONVERTER E EVALUATION BOARD 


TDC1007PCB/TDC1014PCB 
TSK69000A — EVALUATION PRINTED CIRCUIT BOARD LAYOUT (1X) 
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Etra Consulting 
640 Jones Road, Englewood, NJ 07631 Tel: (201) 567 3169 Fanc (201) 567 1638 


William Etra 
December 5th 1991 


Patent - Automating Presentation 


Abstract: A method is described for automating the process of creating a video 
or film presentation ranging in complexity from a simple animation of 
a spreadsheet plus text to creating a feature video or film. The level of 
automation ranges from a brief description of the audience and 
display conditions to full control of every aspect of professional 
production. 


The user can elect to input any level from the fully automated mode to 
a mode that will educate the user in any or all of the techniques 


required for production. 


Aspects of production required for a professional product include: 


a) Composition 
b) Lighting 
c) Timing 


d) ‘Transition style 
e) Soundtrack 
- wild 
- overhub 
- special 7x 
- foley 
- scoring 
f) Character Interaction 
- script derivation from text 
- comic movement and shtick/Lots1 
g) Generation of 2D & 3D, storyboard for live 
action 
and more parameters covered in the claims 


Patent - Automating Presentation/2 
December Sth 1991 


Abstract Cont. 


History: 


The basic premise is that the system gives the user full control of the 
production process. This is the first time that the creator of the idea 
will have full control of the end result. 


For the last 20+ years I have been looking to produce a tool that 
would give an individual control over the production process. The 
basic problem being that computer graphics and video technology 
share a lot of production value as music, but lacks a compositional 
instrument (e.g. a piano) 


It is my hope that this invention should be combined with U.S. Patent 
# 5,012,334/4.30.91 for the acquisition of existing visuals. The 
storyboards for live shooting can be automated by allowing the 
microprocessor to control the process of creating a shooting script 
and dialog from written material in descriptive, narrative or 

scenario form. 


The information required to accomplish this exists in the basic 
production rules to be applied which are already well established. 
They apply to: 


a) Composition 

b) — Shot Angles 

c) Movement (i.e. Panning, tilting and zooming or 
dollying the camera) 

d) _ Lens settings 

é) Sound 

. Recorded on scene 

. Dubbed vocals 

. Sound Effects 

. Folly studio 


mb WN 


. Music and scoring 
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Patent - Automating Presentation/3 
December 5th 1991 


History Cont. 


f) Character interaction including 1) Dialog 2) Movement 
(body action) d) Shtick, Lotsi (bits of action) 


Without these rules soap operas or situation comedy programs could 
not be produced. Adding the basic rules of character 

interaction which have been around since the beginnings of Comedia 
del Arte traceable to the early 13th Century. The user highlights parts 
of their text that requires one or more characters to emphasize a key 
poini, the microprocessor can do the modification to represent simple 
dialog. We enhance this by allowing the user to select archetypical 
characters from a menu (with the software interactively helping to 
suggest optimal choices). Each character carries with it Lotsi or 
Shtick (humorous routines) to be applied depending on length of 
scene importance and subject. The result of this process can either be 
an animation or a storyboard. This allows an A/V department to 
shoot live production to precise specifications. In either case the 
individual writer has maintained control over the production process. 


The script generated by the computer is tested and 

modified by comparison with demographic and psychological stored 
data. This data has been collected from existing material 

generated from audience reaction to test animatics or finished product. 
The fact that everything from lighting to timing, to character 
interaction is in the computer allows enormous simplification when 
material requires modification. 


The argument that to produce a quality film or video presentation 
requires art not computer interaction is spurious. My experience as a 
practitioner and university teacher of film and television indicates that 
if the simple rules are applied to any material, a watchable film or 


Patent - Automating Presentation/4 
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History Cont. 
video animation can be produced. An individual's talent will 
obviously have an effect on the quality of the end product. 


Though several experiments in script generation were tried in the past 
(most notable being done in the 50s at M.LT.) to my knowledge the 
rules of character interaction as in Comedia del Arte have not been 
used. 


Claims: 


ie A computer controlled system to analyze written descriptions 
relative to user input describing audience and display characteristics 
(i.e. demographic and psychological data) being used to generate 
animation, or shot descriptions for the production of video and or 
film automatically including shot timing, lighting, motion, character 
interaction, tilting, morphing, type of scene transition, composition, 
screen format, color style and sound (including a. wild b. redubing 
c. recorded FX d. foley e. scoring and orchestration). 


2. A system for applying rules of various aspects of TV and Film 
production according to display conditions and the interest and 
composition of the audience. ‘The selective choices being done by a 
program running on a computer workstation (i.e. ranging from 
specialized high power computers to general purpose microprocessor 
machines [laptops or palmtops]). 


3. A software program for weighting production values relative to 
conditions of display composition of audience and desired 
psychological effect. 
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Patent - Automating Presentation/S 


December 5th 1991 
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4. A Microprocessor based system for generating dialog for 
2D, 3D animated or storyboards for live actors that generates script 
dialog from descriptive narrative or scenario text based on the 
audience demographic and desired effect. 


3. The system described in claims 1 - 4 which automatically 
selects character types based on audience and desired reaction. 


6. A system as described in claims | - 5 which stores and 
distributes character based movements and dialog (i.e. Lotsi in 
Comedia del Arte or Shtick in Vaudeville) to the animated 
character or the script and storyboard for live actors. 


ae A system as described in the previous claims which allows 
the user to highlight parts of the descriptive text to indicate the 
importance of a specific idea. The interactive software that 
allows the system io suggest characters, production values, 
and background based on previous choices of the user as well 
as basic rules of character interaction and production techniques. A 
heuristic system which becomes easier to use with lime. 


8. A system as described in claims # 1-7 which automates all phases of 
the basic soundtrack generation in one or more of the following ways: 


a) Having the computer generate the voice irack from text 
using digital voice generation or lookup of pre-recorded Patent 
human voice derived from direct input or by computer 
extraction of recorded materials (i.e. T.V., Radio, Film etc). 
This involves proprietary software to differentiate voice 
patterns and timings and compare individual words and 
phrases against desired libraries and to compress and store 


Patent - Automating Presentation/6 
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Claims Cont. 


8. voice patierns plus speech patterns timing to generate a full 
library of all desired phrases and words. 


c) Foley - the addition of timed sound effects based on actions 
i.e. footsteps, punches, gongs etc. This is done by looking for 
objects meeting on the screen, deciding what materials and 
acoustics apply to the current screen (in 2D and 3D animation 
this is part of the character and object description) in live 
interaction, coincidence or meeting of objects which can either 
be done by image processing or by operator specification of 
frame or field. SMPTE timecode being common to midi sound 
and video or film editing and marking the area of coincidence 
specific areas being designated by the user graphically. 


d) Scoring is done by computer selection of available music 
type and section of piece to be used and weighted based on 
selection derived from audience demographic, psychological 
and presentation condition information selected and 
automated or by the users as well as type of scene transition 
and effect desired. 


e) Lip synchronization is done by matching dialog script to 
phonemes and modifying the correct lip shape based on 
applying third order differential equations (in DDA fashion) 
as address for the mouth area. 


9. A system as described in the previous claims that extracts character 
types from existing film or video and with user interaction extracts 
voice, movement and character information from the material which is 
then used to describe inipraction, movement and voice for 2D and 3D 
animation as well as storyboards for live recording. 


Patent - Automating Presentation/7 
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Claims Cont. 


10. A system as described in previous claims that can extract 3D 
information from film or video material. This is done by analy zug 
shadow and lighting reflection (as in Z axis generation, frame by 
frame and motion analysis as in US patent # 4,262,926/4.28.81 and by 
studying size perspective change). ‘This information to be used to 
recreate scenes in 2D or 3D animated or live action form. 


{1. A system as described in previous claims which uses a radio of other 
radiation triangulation system (including audio, infrared, laser or 
other) while taping live action recording this plus3D motion 6 axis x, 
y, Z pitch, yaw and role in both relative and absolute form to a main 
position (either static or moving i.e. camera action, car or other 
vehicle or high point of landscape or scenery) adding in camera 
lensing information and time code, (preferably SMPTE). The selected 
information being used to combine live action with 3D or 2D 
animated sequences. A recorder being attached to all objects to be 
combined (i.e. actors, vehicles etc.) plus all cameras being used to 
record the live action. 


12. A-system as described in the previous claims using a frequency 
generation system above the level of standard recorders and small 
devices attached to all important objects in a live video or film shoot. 
Each microphone having its own digital optimized recording memory 
which records both generated frequency and time code synchronous 
to the video or film recorder (SMPTE preferred). The collected 
information being used to generate a sound model for combination of 
sound track with 2D or 3D animation or for generating a high degree 
of realism in standard production. For point of view from a 
characters position, microphones at ear position 1 left, 1 right are 
necessary to accomplish this if Binaural sound is desired. 
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Claims Cont. 


‘This sysiem can be used for implementation triangulation of claim # 
11. 
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13. A system as described in previous claims which generates shading for 
2D animation by creating a pseude phong model through differential 
equations referencing a centered stick figure skeleton structure added 
to the characature definition in the library and applies luminance 
change according to up to 3rd order differential (umplemented with 
hardware or software DDAs feedback between the x and y 
counters. 


14. A-system as described in previous claims which automatically 
generates motion blur by positioning and compositing in an alpha or 
luminance buffer with 3rd order dda address counters (so it can be 
placed in proper perspective) and feedback can be generated to 
simulate motion blur. 10 bits of look up table if the buffer is 8 bits. 


15. A system as described in claim # 14 which is used to generate 
shadows automatically with varying feedback to soften the effect. 


16. A system as described in the previous claims which allows the 
computer to generate an increasingly complex level of "pencil test” or 
previewing “wireframe” test animations for user revue and 
modification, a number of which can be run in real time. 
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VIDEO MODULAR SYSTEMS FEATURES 


Compatible with TRS-80; PDP-11; Q or Unibus; S-100, Apple and GPIB 
Full color genlock capable of locking to 3/4'’; Betamax and VHS recorders 


. Four times color subcarrier sampling rates 

. Single module change converts system from NTSC to PAL 

. Built-in special test generator, teaches RGB color mixing 

. Full compatibility with S-100 computer bus and 8080, Z-80 software 

. Built-in dither generator for anti-aliasing (softens hard diagonal edges) 
. Modular construction allows almost infinite expansion 

. Up to sixteen levels of soft or hard edge digital keys or wipes 

. Full system update during vertical blanking interval — 

. 4096 colors; 4bitseach R, GandB 

. Computer animation 

. Full color zoom, pan, tilt, squeeze and/or wobble; any form of distortion in real-time 
. Full optical bench effects 
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VIDEO MODULAR SYSTEMS DESCRIPTION 


Video Modular Systems (VMS) represent a new approach to the design of video special effects equipment. 
This set of modules bears little resemblance to commercial video equipment now available on the market. 


The best method of describing the system is to relate it to computer architecture. VMS is, in effect, a modul- 
ar high-speed computer with a bit slice, pipeline architecture. Using the computer model, VMS takes on 
the following characteristics. The A/D converter is the system's input device for high-speed data. The 8 in-3 
out switch is an analog multiplexer for high-speed |/O. The Firmware Interface Processor/Controller is the 
slow-speed bus buffer which interprets and formats data from the computer. The maps on the A/D and D/A 
modules serve as input and output registers for the Central Processing Unit (CPU). Both the Video Process- 
ing Unit (VPU) and the Multiplexer Key Matrix (MKM) act as part of the CPU. The MKM controls the data 
from its low-speed mode and does arithmetic operations in its high-speed mode. The VPU is the major Arith- 
metic and Logic Unit (ALU) for the CPU. The Pattern Generator is a complex real-time events counter and 
clock. It provides control over the analog and digital multiplexers on the high-speed bus, as well as special 
clocking when needed in the VPU. 


Every signal in the VMS is based on the system clock. This master clock comes from the RGB encoder and 
is derived by multiplying the 3.58 color subcarrier by 4, or, in its absence, from its own internal crystal 
oscillator. The RGB encoder serves as a data translator and formatter, translating the high-speed bus 
signals back to television signals and adds sync pulses, etcetera. The D/A converter is the final digital 
buffer; it translates the data to a form acceptable to the RGB encoder. Frame buffers serve as cash mem- 
ory for the high-speed data, thus allowing the data to be stored and moved, as well as re-formatted. The 
RGB Decoder is a special data formatter. It allows for individual channel processing of color data. 


VMS utilizes a unique concept which allows it to process the high-speed video signal in real-time (Note: 
Real-time actually refers to a minimal delay—nothing happens instantly). By using the incoming data as 
address on anumber of memory locations and repeating the process with the output of the memory a num- 
ber of times, various relationships can be set up in the memory (see tables) and complex relationships can 
be set up between signals. The use of multiple signals as address on the same memory expands this con- 
cept and allows all possible combinations to be achieved. With this method in operation, the user need not 
know the content of the signal in order to process it. One way of understanding the nature of VMS is to con- 
sider the logic base of the system. It is based on whatever the video value is during the current sampling 
period, not on ones or zeroes or positive and negative values. This unique floating number base allows the 
system to act on video in real-time. 
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COLORIZER CONFIGURATION 


One of the basic features of the VMS is a simple sixteen level-4096 color colorizer. The colorizer utilizes the 
four most basic VMS modules—the A/D, D/A RGB encoder and the computer interface. When using these 
modules as a colorizer for a single black and white video source (independent sources can be used for the 
RGB inputs if desired), they are configured as described below. 


The video is connected to the genlock-in on the RGB encoder and the R, G and B inputs of the A/D module. 
The unmapped outputs of the A/D are connected to the mapped inputs on the D/A (only one map is required 
to operate in this configuration). D/A outputs are input into the RGB inputs of the encoder. The clock out- 
puts are connected to A/D and D/A clock inputs. The computer interface is connected to the control input 
of the D/A module. Please note that only the D/A is fed information from the computer in this configuration. 
The computer interface can be replaced by parallel line outputs. This replacement is not supported by our 
software, however, and is not suggested. 


The colorizer theory of operation is simple. It consists of loading the R, G and B channel memory maps with 
data. Since the incoming video is used to address the memory location (i.e. level @ addresses memory 
space @; level 3, memory space 3, etc.), filling memory locations @ through 15 with values @ through 15 in 
all three channels results in a sixteen level black and white display. In order to colorize the picture memory, 
values must be changed. 


The colorizer program fills the computer screen with the display in Figure #1. Rows @ through 15 (bottom 
to top) are filled with sixteen successive columns of R, G and B’s, representing values @ through 15 (left to 
right). The final column positions, @ through 15, represent the value selected for R, G and B in that row. If 
two primary colors have the same value, a ‘‘+’’ is present to represent the overstrike. 


Values are selected by positioning the cursor over the appropriate R, G or B and hitting the ‘‘*"’ key. This 
replaces the R, Gor B which then appears in the appropriate column of the last sixteen positions. Activat- 
ing the test generator in the A/D box will produce, on the color monitor, the display in Figure #2. The test 
display sections the monitor into four vertical columns, from left to right, Red, Green, Blue and Mixed 


Color; and sixteen horizontal rows, from bottom to top, @ to 15. This display is the analog of the computer 
terminal screen. 
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FIGURE #2 VMS COLOR CONFIGURATION 
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ANALOG TO DIGITAL (A/D) CONVERTER 
(MAPPED) 


The VMS A/D Converter takes advantage of the latest in LS! chip technology for a 4 bit, 16 level, 3 channel 
A/D converter. The unit is capable of running at speeds far greater than the 4x subcarrier which is the sys- 
tem’s normal internal clock speed. 


The unit takes in a composite video signal, strips sync on three video inputs (R, G and B) and may either be 
clocked by the system clock or free-run. 


The output of the A/D converter addresses a memory map. The read address for the memory comes from 
the video; the write address and data comes from the computer during vertical blanking interval. This 
allows any luminancevalue to be reassigned any other value. It allows complex outlining and other colori- 
zation functions when used on a single or multiple black and white signal. Complex reassignment and color 
manipulation can also be performed on a decoded color signal. Both the mapped and unmapped digital 
signals are available and both can be used with other VMS modules. It should be noted that while the A/D 
module was specifically designed for video, it can be used in a number of ways with audio frequency 
signals. 


PRELIMINARY SPECIFICATIONS: 


Inputs: R., G, B in (3), 1 volt peak-to-peak composite or non-composite video into 7502 + 2qB, 0-4.5 
a in: 14.318 MHz typ., 20 MHz max, ((2) 74S TTL Loads) 
control port: 8 bit data bus, 12 bit address bus. 

Outputs: Digital Video (Out) 4 bits x 3 channels (R, G, B) will drive 10 TTL loads. 

Mechanical: 4.94’ x 5.68” x 18” 


Power: 115/230 VAC 50/60Hz, 60W (max). 


——DA CONVERTER (MAPPED) ae 
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DA CONVERTER (MAPPED) 


The VMS Digital to Analog (D/A) Converter Module is used to convert the digital 4-bit signal back to an ana- 
log voltage for the RGB encoder. In the same manner that the A/D converter has memory on its output, the 
D/A converter has a memory map on its input. When using the A/D, D/A and encoder as a colorizer, only 
one map is required. The theory of map operation is the same in both the case of the A/D and D/A conver- 
ter. Incoming data is used as read address on the memory. For example, a value of five is translated into 
whatever data is in memory location five. The data in the memory is provided by the computer during the 
previous picture scan to the interface and is loaded into the module during vertical blanking interval (not 
scan). As mentioned earlier, either the A/D or D/A map is ignored during colorizer application. 
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RGB ENCODER MODULE 


The VMS RGB Encoder is designed to take R, G and B signals at standard video levels or positive going TTL 
Logic, and provide an NTSC signal output. The module is also designed as a genlock to provide synchroni-’ 
zation with the other modules in the VMS system. In order to accomplish this, the device has ail the stand- 
ard video synchronization outputs as well as a clock for the VMS System, running at 4x color subcarrier. 


If the unit has subcarrier coming into the geniock input, then the clock pulse and color signal. If no sub- 
carrier is present at the genlock input, color and clock pulse are generated internally by a crystal. 


Two optional plug-in boards exist for this unit. One is a color bar and test pattern generator; the other option 
is an internal sync generator. When the sync generator option is activated, non-synchronous color signals 
are provided with synchronous color output. The RGB encoder module may be used as an encoder for digi- 
tal frame and field store units such as those used in computers, as well as in conjunction with the VMS digi- 
tal video synthesizer equipment. The test signal generator can be combined with the VMS vector adaptor 
display module to provide a basis for camera and VTR alignment. 


Inherent in the RGB encoder TTL level sync outputs is its ability, without the use of extra circuitry, to pro- 


duce video sync information in a computer-readable form. The video sync pulses can then be used by the 
computer for information and interrupt driving. 


PRELIMINARY SPECIFICATIONS: 


Inputs: 1 volt peak-to-peak composite reference video R, G, B inputs (3) - each 0-1 volt (7552) 


Outputs: Composite video out 1 volt peak-to-peak into 75 C2 (Output is locked to reference video input; sync is 
of same quality as reference video input) 


composite sync out, 4V peak-to-peak into 7562 


composite blanking out, 4 V peak-to-peak into 7502. 


8 INPUT/3 OUTPUT MATRIX SWITCH 


VIDEO 
MODULAR 
SYSTEMS 


1440 San Pablo Ave. 


Berkeley, CA. 94702 
Tel: (415) 527-7700 


Attn: Bob Walker 


VMS CONFIGURATION 
(Shown with TRS-80 Computer) 


8 INPUT/3 OUTPUT MATRIX SWITCH 


The applications of this module are too numerous to be adequately described on this sheet. In its simplest 
form, the unit functions as a basic vertical interval video switcher, letting any one of eight inputs to be fed 
to the R, Gor B input of the VMS Digital Video Colorizer. Since the unit will switch either composite or non- 
composite video signals, it may also be used for display and general signal switching. The device provides 
computer-controlled programs which permit the use of various video sources and monitors, in a manner 
similar to multiple slide projector and multi-media presentations. 


Audio signals can ae be entered at proper video levels. The first of these inputs contains a microphone 
preamplifier which allows voice to be entered without any special equipment other than a microphone. Be- 
cause the computer inputs can be mixed with higher speed digital signals, they can also be used in conjunc- 
tion with the A/D converter and pattern generator as a multiple level key or wipe generator. The complexity 
of these keys and wipes are dependent upon the number of the eight input-three output switching modules 
present in a particular system. 


A significant feature of this module is its computer's ability to change the program during vertical blanking 
interval. A very smali computer with our simple software can program real-time cutting. The result would 
appear to be the product of a very complex editing job. 


The software provided allows easy programming of the switching functions and overall timing changes. Pro- 
grams can be synchronized with audio inputs, and complex mathematical relationships between selected 
picture inputs can be formulated. This particular feature enhances the capabilities of the VMS Digital Video 
Synthesizer. Until now these options were only available in devices costing ten times the price of this con- 
figured system. 
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FIRMWARE INTERFACE PROCESSOR /CONTROLLER 


The VMS Firmware Interface Processor/Controller (FIP/C) occupies a double size module and contains a 
ie §-100 bus, includirig Z-80 type microprocessor operating at 4.0 MHz, in addition to our special purpose 
us. 


The operation principle is simple. The appropriate lead goes to the microprocessor adaptors toward S-100, 
TRS-80, Apple, LSI-11-Q bus or Unibus and appears as memory to the host computer. The computer is 
sent a not-vertical blanking signal which allows it to load the interface while the field is being written. During 
vertical blanking interval, the interface loads the VMS Digital Synthesizer from its own memory. The inter- 
face microprocessor also polls the devices to which it is connected, to determine their address and func- 
tion. The interface contains its own program ROMs which may be changed as the unit is updated. All of the 
basic pees such as the colorizer program can be downloaded to the host computer. The FIP/C is a 
standard S-100 computer and can be used to incorporate standard peripherals into the computer. Devices 
such as the Golemics, Inc.’s 256 channel A/D converter will be available with joysticks, sliders, knobs and 
the software to integrate these hand controls into the system. 


The interface processor/controller will handle sixteen modules. Multiple interfaces may be used in a multi- 
processor configuration. Please note that the color vector display and the encoder need no computer 
hook-up. 


Keyboards, communications interfaces and modems will be available as options, as well as special purpose 
ROM programs for video processing and effects for those not intending to use the unit either remote or 
direct with a host processor. 
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RGB DECODER MODULE 


The VMS-RGB Decoder Module takes a composite color video signal and breaks it down into separate red, 
green and blue non-composite signals. The output of the decoder is suitable for input into the A/D conver- 
ter. With this configuration, a single color video source is treated as R, G and B components of 4-bit resol- 
ution, making 12-bits of overall signal processing. 


When the decoder is used in front of the A/D converter in a colorizer configuration, the system acts as a 
color correction and change processor. Colors in the picture can now be changed individually. For instance, 
ared dress in the picture can be made blue; problems in skin tone may be corrected without changing the 
other colors in the picture. Multiple color signal processing is possible when additional RGB Decoders are 
incorporated into a VMS configuration and in that case, however, it is advisable to add the appropriate num- 
ber of multiplexer boards. 


When used in conjunction with the video processing module, the decoder helps generate very precise 
chromakeys (one or more out of 4,096 colors). The stringent lighting requirements usually associated with 
the chromakey effect are no longer necessary with the use of this device. 


Hl 
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VIDEO PROCESSING UNIT- 
VIDEO COMBINATORIAL PROCESSOR 


The Video Processing Unit (VPU) extends the memory mapping concept used in the A/D and D/A modules, 
giving the system extended combinatorial power. 


The mapping concept used in VMS is a relatively simple one (Figure #1). Real-time data (i.e. video) is used 
to provide an address for a memory cell. For example, a value of level 5 coming in to the system displays 
the data located in memory location 5. The data in the memory is provided by the picture scan and loaded 
into the memory during the next vertical blanking interval. 


In this way, any other value may be substituted and the substitute value can be changed every vertical 
blanking interval (once per field). This real-time mapping function results in the production of effects com- 
parabie to those hitherto achieved only in post production editing. 


The VPU expands the simple map function by increasing the size and number of the maps through the use 
of a 256 x 4 bit memory map (Figure #2). Two 4-bit signals address the map. One signal acts as the Isb and 
the other acts as the msb (least and most significant bits, respectively), thus substitution for every possible 
combination of the two signals is possible (Map A, Figure #2). The same procedure is carried out with the 
inputs to a second memory space of the same size (Map B, Figure #2). The ALU’s on the outputs allow com- 
plementing (inverting the signal) and other arithmetic and Boolean functions to be implemented. The two 
4-bit outputs of the ALU’s are then used as address on a third map (Map C, Figure #2). This allows any 
combination of substitutions to be made, as well as complex mathematical relationships to be set up be- 
tween the four inputs. If the pattern generator is used as an input, wipes as well as keys may be executed. 
When stored fields are compared with current fields, complex image processing can be done in real-time. 


The VPU is capable of executing most mathematical functions between its inputs in real-time. Until the in- 
troduction of the VMS, this could only be achieved with complex programming in stored time. 


With the addition of the VPU, the VMS begins to reveal its true nature. The system is a pipeline computer, 
handling video in real-time. This is achieved because the system does not attempt to analyze the video 
passing through it, but performs function upon it. The video in the system takes on the role of the logic base 
for the processor. This logic base is not either positive or negative but has as its base whatever the video 
signal happens to be at the particular sampling period. 
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MULTIPLEXER KEY MATRIX (MKM) 


Tne MKM system has two basic operating modes, and while the theory of operation is the same in both, the 
visual effects are dramatically different. The unit is a 16 input-4 output, 4 bit, 3 channel (RGB) matrix switch 
with a 16x4 map on the switch selector inputs. The two modes are program selected. Switching inputs 
either come from the computer (slow speed) during vertical blanking interval, or from a real-time signal 
(high speed) such as digitized video of the pattern generator. 


When the MKM is in the slow speed mode, it eliminates the need to rearrange the position of the modules. 
This allows all digital patching to be done by the computer and greatly expands the capabilities of the sys- 
tem, since the device may be rearranged during vertical blanking interval. Please note that the multiplexer 
is limited to sixteen inputs, although these units may be ganged together to make almost any number of in- 
puts and outputs. 


Implementation of the high speed mode produces a broad based, multi-level digital video keyer with up to 
sixteen levels. If the input to the device is the output of the VPU, soft edges keys are also possible. if the in- 
put is from the RGB decoder, then compiex chromakeys can be implemented. 


The key function is implemented by setting the input map so that it contains only two values (see Figure #1). 
One value signifies the lower range of the grey scale and the other represents the upper range. We now 
have a standard video key, in which the input to the map determines the shape of the key and the two sel- 
ected values in the map indicate the video signal inside and outside the key. If the maps contain more than 
one value, the number of levels in the key is extended. If the data to the map is a mix of the data being 
switched, soft edged and similar effects are the result. 


The MKM’s use in combining stored time (frame store) video images with current (real-time) images is 
its most important function. By continually recombining past and current frames, a high level of image fil- 
tering can be achieved. This is only possible with the computer controller patch capability of the MKM. 


The MKM plays a major role in the Video Modular Systems’ expansibility. Its multi-level architecture, com- 
bined with the ability to run multiple interfaces in parallel, allows almost infinite system expansion. 
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PATTERN GENERATOR MODULE 


The VMS Pattern Generator Module consists of two phase accumulator type digital frequency synthesizers 
and an arithmetic logic unit (ALU.). During normal operation, one synthesizer generates a horizontal pat- 
tern while the other generates vertical patterns. The ALU generates a logical or arithmetic function of the 
two. These three outputs are available in digital and analog form, and are valuable for pattern and wipe 
generation. 


The pattern generator can be used in conjunction with the 8 in- 3 out switching module to create wipes be- 
tween input channels. The outputs can be mixed with other signals in the VPUs or be used to switch chan- 
nels on the sixteen input mux. 


Almost any shape or pattern can be produced by the pattern generator. By increasing frequency, the pat- 
tern can be multiplied, and by offsetting the frequency slightly, it can be moved through the picture at a 
controlled rate. Because VMS is divided in R, G and B channels, one or more pattern generators can be 
used to window different video signals in various colors. This windowing effect leads to many interesting 
possibilities when used to isolate important information in the picture. 


in an experiment, the color of the window in a close-up picture of a subject can be changed according to 
the data being monitored. Pattern generators can also be used to generate real-time moving backgrounds 
for animations done in the frame buffers. Audio synchronization of pattern generator outputs can be achiev- 
ed by mixing them with audio signals in the VPU. 


Synchronization of audio and video has been possible for some time. But with the VMS modules under com- 
puter control, complex relationships, never before possible, are obtainable. The analog outputs of the pat- 
tern generator can be used to make video timings available to audio synthesizers. 


PRELIMINARY SPECIFICATIONS: Inputs: Clock-DC to 20 MHz (system video clock freq = 14.318 MHz) 
Resetable up to 20 MHz (normaily reset at horizontal or vertical video rates) 


Outputs: 1024 segment pattern 
16 possible tevels/segment 
pattern size adjustable in 70 nsec pixel increments 
resolution of one horizontal pixel, 70 nsec 


Mechanical: 4.94" x 5.68” x 18” 
Power: 115/230 VAC 
50/60 Hz 


50 W (max) 
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FRAME BUFFER 


The VMS Frame Buffer module is a double-size unit, housing two S-100 type backplanes. The system re- 
quires VMS control and any type of S-100 memory on 32K boards, with memory speed of better than 500 
nanoseconds. The VMS Frame Buffer module contro! electronics contain special digital dither electronics, 
which allow the system to vibrate the pixels and smooth out the picture, eliminating stairstep and aliasing 
phenomenon on diagonal straight edges. Thus, the picture is ensured to have a smooth, rather than digital, 
appearance. 


The VMS Frame Buffer serves two major functions. 


It is a video storage device. The Frame Buffer, as its name implies, stores video on a field basis, allowing 
the system to process stored time events with each other and with real-time events. Functions such as 
zooming, panning, and image distortion can be accomplished with the module mathematically processing 
the input to both the read and write memory counters. The VMS Frame Buffer is comprised of a matrix of 
390 horizontal dots by 600 vertical dots per field. (Note: For NTSC video, only 500 of the 600 vertical dots 
are used. The added resolution is for PAL systems which also require a PAL encoder.) 


The second major function of the VMS Frame Buffer module is the generation of computer graphics. The 
device receives information either from the computer or as real-time signal under program control. The 
number of frame buffers configured in the system determines the permutations of graphic data, real-time 
signals and various effects possible between them. 


The buffers are fed through the computer interface but a number of options are available for control of the 
intelligent interface. S-100 peripheral devices include A/D converter boards with knobs and joysticks, 
touch-sensitive tablets, digitizer tablet, character generators, and keyboards. VMS provides a program- 
mable genlock character generator, a 256 channel A/D converter, and a touch tablet as support options. 


The ability to perform all the complex video routing and effects with hooks for control from BASIC is pre- 
sently available. 


VMS is currently engaged in work on a major software development project which is expected to yield a 
special graphics control language. We estimate completion of this language by the end of 1979. It should 
be noted that the software development has been in progress for four years and predates the actual equip- 
ment development. We consider software support to be an ongoing process. 
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COLOR VECTOR DISPLAY ADAPTOR 


The VMS Vector Dispiay Adaptor is made for use with any oscilliscope which has a speed of 500 KHZ or 
better and an external trigger. The device generates standard vector (clock face) display of color, as used 
in color video equipment calibration in broadcast facilities. The adaptor is one-sixth the price of ‘‘tradi- 
tional’ vectorscopes. So, for the first time, smaller studios can have this type of display without the custom- 
ary expense. 


The device can also switch between vector display and stable video waveforms at vertical or horizontal 
speeds. This makes professional-calibre test equipment available at a fraction of the usual price. 


The vector adaption module is designed to take a number of plug-in expansions. The first of these options 
will be the RGB decoder board which will allow chromakey to be added to video production facilities with 
minimal cost. The vector adaptor becomes particularly useful when combined with the VMS encoder- 
genlock. This combination is enhanced if the encoder is equipped with optional color bar and test pattern 
generator. 


The vector adaptor takes advantage of the latest in solid-state technology to make it possible for an oscilli- 
scope to enter the realm of broadcast studio-type signal evaluation and display. The module takes in NTSC 
or RS170 composite video sync (PAL version will be available shortly) and sends out the X and Y signals 
needed to drive a standard oscilliscope. A rotation knob for proper positioning of the display and a set of 
overlays which will fit most oscilliscope faceplates are provided. 


PRELIMINARY SPECIFICATIONS: inputs: 1 Volt peak-to-peak composite video 
1 Volt peak-to-peak external subcarrier 


Outputs: x out, 6 V peak-to-peak 
y out, 2 V peak-to-peak 
X' out, 10 V peak-to-peak, ramp 
Y’ out, 1 V peak-to-peak composite video, clamped to Gnd 
during ramp, to+10 V during retrace (to blank screen) 


Controls: rotation 
internal /external subcarrier switch 
view vector display/view video waveform switch 


Mechanical: 4.94'' x 5.68” x 18” 


Power: 115/230 VAC, 50/60Hz, 20 W max. 
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. Limited to 25. Tne purpose of this 

- course is to introduce the unini- 
tiated into the world of affordable 
computers ($80-$5,000). No prior 
knowledge of computing is neces- 
sary. The course teaches every- 
thing you need to-know in order: to- 
get invoived in this interesting and 
useful hobby. There will be guest 
lecturers, demonstrations, and 
some hands-on experience with a 
number of the new micro-com- 
puter systems. Special attention 


is given to those wishing to 


develop a system of their own. 
Topics include: how computers 
think—binary numbers; computer 
. languages and how they work; 
“operating systems; selecting a 
home computer; buying or buiid- 
ing your own; the care and feeding 
of your home computer; cheap 
peripherals; and what to expect in 
, the next ten years. 


WILLIAM ETRA, 
INSTRUCTOR 


B.F.A., NYU School of the Arts; video 
artist consultant for video special 
effects & computer assisted animation 


.. Systems. Associate. designer: Rutt/Etra 
“Video Synthesizer; Videolab-Electronic ~ * 


Assoc. of Berkeley. Grants: The Nat'l. 
Endowment for the Arts; The N.Y. State 
Council on the Arts. Exhibitions: co- 
director 2nd, 3rd, 4th int’l. Computer Art 
Festival; The Whitney Museum of Ameri- 
can Art; The Everson Museum; The 
Strasenburgh Planetarium; The Kitchen 
Center for Video & Music; Anthology 
Film. & Video Archives. Taught: Ass’t. 
Prof. of Film & TV, U. of Maryland; NYU 
School of the Arts; Dickson Art Cen- 
ter—UCLA; U. of Arizona-Tucson. 


COURSE NO. 4848-2 
TUES., 5:55-8:55 PM, — 
BEG. FEB. 1.$190. - 
REGISTRATION INFORMATION 


Mail Registration : 
‘Will-be- accepted if postmarked no later” 
than January 19. 

Master Charge and BankAmericard 
are honored for Mail and in-Person- 
registration. Holders may also register 
by phone weekdays through January 21, 
9:30 a.m.-3 p.m. Call 741-5610. 
in-Person Registration 

Mondays through Thursdays, through 
January 20, 4-7 p.m. 

Mondays through Fridays, January 24 
through January 28, 1-8 p.m.; 

January 31 through February 11, 10 
a.m.-8 p.m. 

Saturdays, January 29, February 5 and 
12,9 a.m.-1 p.m. , 


Registration Fee: $15 


Tuition Fee: $95 per credit. The 
number of credits is indicated after the 
dash in the course number. 
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